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ABSTRACT 

This thesis outlines a new way of presenting the theory of canonic 
systems, including a distinction (for methodic reasons) between simple 
canonic systems and general canonic systems , and proves a series of re- 
sults on hierarchies of canonic systems. After a brief summary of Doyle's 
results on a partial hierarchy of canonic systems, a new hierarchy is 
developed (Chapter II) which relates the general canonic systems not only 
to all 4 types of formal grammars defined by Chomsky but also to eny class 
of formal grammars definable in terms of productions. It is also shown 
(Chapter III) that all attempts to define a mathematical system which ex- 
actly corresponds to the recursive sets are necessarily fruitless. 
Doyle's work on how to define "noncontracting canonic systems with predi- 
cates of degree 2" (NCST) is continued, arriving at a workable definition 
which permits us to prove [NCST] * [Type 1] (Chapter IV) , a conjecture 
put forth at the Hid Princeton Conference on Information Sciences and 
Systems. This results transforms Doyle's hierarchy from "the union of 
two half-hierarchies and a dangling term (the NCST)" into a complete hi- 
erarchy of canonic systems (all 4 types represented). However, this hi- 
erarchy is heterogenous : canonic systems corresponding to grammars of 
types 3 and 2 use only predicates of degree 1, while canonic systems cor- 
responding to grammars of types 1 and use also predicates of degree 2; 
moreover, for all types of grammars except for context-sensitive grammars 
the canonic systems turned out to be simple. Schematically, the form 
of this hierarchy may be summarized as 

SI SI Gl S2 (for types 3, 2, 1, 0) . 

We first show (Chapter V) how to get a hierarchy of simple canonic sy steins, 

SI SI S2 S2 
using as base Doyle's hierarchy, and then transform it into 

SI SI S2 SI 
Since this hierarchy does not seem to lend itself to further "homogeni- 
zation", we sh*ll use the hierarchy of Chapter II to obtain t hierarchy 
of simple canonic systems with predicates of degree 1: 

SI SI SI SI 
Several new classes of canonic systems ( non-cross referencing , non- insert- 
in g , and pure canonic systems) are introduced in Chapter VI, where their 
properties are explored, and a classification schema and several hierar- 
chies are developed. 
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CHAPTER I 



SIMPLE AND GKHERAL CAWONIC SYSTEMS 

This chapter presents the differences between the traditional defi- 
nitions and the ones we will use, and builds the theory of canonic sys- 
tems according to the new specifications. It also includes the motiva- 
tion for the reorganisation of 'canonic systems , 

Canonic systems were first defined In Donovan 1966 . The starting 
point of our work was the version presented in Donovan and Doyle 1968, 
p». 3-9. The reader is assumed to be acquainted with this work, and 
therefore we will not repeat tiiatdefinitioalHit rather present the 
?e^!iS!Ji2S» w hmv * introduced and the arguments behind them, and then 
present only the modified definition. 

A canon used to be defined as a list of statements followed by the 
sign |- and then followed by a statement . where a statement (tradition- 
ally called f remark 1 ) la composed of a tera of some degree followed by 

a JKSSiSSmS of tha Bm * de 8 ree * A tmTm of degree n is an n- tuple of 
arbitrary concatenations of variables and words on the given alphabet, 
the words surrounding the variables being referred to as the context 
of the variablea. A particular case was singled out, the caae when 
context is actually indicated, and the canonic systems satisfying this 
condition, i.e. canonic systems which contain at least one canon in 
frtiich there is an instance of vsrisbles and symbols concatenated together 
in the same term, were called Mfitolc_a^|*^ jeith Jo*iofSf*.522SS*S 
(CSWIC) [Donovan and Boyle 1968, pw 2% Baggerty 19ifc, p # 41} v but not 
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much was known about them beyond the observation that they appear to be 
rather powerful. Most classes of canonic systems encountered in the 
course of research were not "canonic systems with indicated context" in 
the sense of the old definition mentioned above; no reover, in all cases 
but one, constructive proofs for the existence of canonic systems with a 
certain property yielded canonic systems which were not "with indicated 
context", and the same holds for Alsop's "canonic translator" [Alsop 
1967] . Because of these, and especially in view of Eaggerty's recent 
result [Haggerty 1969] that contextual indications can be dispensed with, 

we have decided not to regard as a distinguished class the class of cano- 

■■■■■(■ 

nic systems which do exercise the option of indicating context, but rather 
to distinguish the class of canonic systems which have no such option 
available, and call them simple_canonic_systems , while the unrestricted 
canonic systems will sometimes be referred to, for emphasis only, as 
general_canonic_systen£ or as canon icjjyst ems jvttb indicated context /. 
[Therefore the new meaning of this term is that we have the option of in- 
dicating contextual conditions, and nothing more than the option, in con- 
trast with the old meaning, which required us to exercise this option in 
at least one canon.] 

The situation is similar to that encountered in automata theory, in 
connection with the definition of nondeterministic automata. The old de- 
finition of canonic systems with indicated context corresponds to the 
following hypothetical definition of the concept 'nondeterministic Turing 
machine' [NTM] : "A KTM is a TM in which there is at least one state sa- 
tisfying the condition that for at least one symbol of the tape alphabet 
there are J]j*2_25_52 r S quadruples [or quintuples, if we work with quin- 
tuples] in the specification of the TM" . According to this definition, 

deterministic TM were not particular cases of ATM but constituted a class 
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OLD 



NEW 




CANONIC SYSTEMS 



CANONIC SYSTEMS » 

- GENERAL CANONIC SYSTEMS - 

- C . S . WITH INDICATED CONTEXT 



Figure 1 

Graphic representation of the changes ij^ temitio^logy 
The circles represent particular examples of canonic systems 



would not be fortunate, and, in fact, this is not the definition of nondeter- 
ministic Turing machines, as everybody knows; rather, the deterministic TMs 
were singled out (were distinguished) as ft ^H^^SS-£f if of N™ 8 * The new 
definition of canonic systems with todica|:ed c<mt^pg& and the introduction of 

the simple canonic systems were necessitated in order to "normalize" the 
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usage in canonic systems , to switch from a nomenclature corresponding to 
the hypothetical def inltfwi of HTM, in oj»a^ttii^ 
which corresponds to the true definition of RIM* 

Similarly, instead of talking of canonic systems w££h insertion, or 
of canonic systems with crossteferencing, etc, we would single out ttie 
canonic systems without insertion, or without cross referencing, etc*.; 
These classes of canonic systems will be introduced sod studied in 
Chapter VI. " 

The way in which we chose to Implement" this reorganisation is by 
introducing p-te*m* ("premise terms") and their lists along with 
terms and thoi* lists, end premises along with statements , A 




tera is an n- tuple each of Miose elements Is "4 M p»re ,f concatena- 
tion (containing either exclusively variablea or exclusively symbols). 
This, incidentally, si so eliminates the recursion on ton , so that 
it will no longer the case thst a substring of a term is, automatically, 
itself a term. 

We are now ready to present the definition of simple canonic systems 
Definitional. A simple canonic system (of level 1 ) is a septuple 



where 



C. is s finite set of canons (rules of inference); 



V. is the alphabet used to form the strings generated by £. ; 

■ l : -■■■■■■ ■ .-_ .-■■ '■ y ::> - ■-. ; r^r.-:.!;.-;^.:-: . . ■ ; t ■ 

M. is a finite set of variables used to stand for elements 
of sny Predicate ; 




P. is a finite aet of prsrfica^s used to ttsme sets of tuples 
The number of compoSBBTTIPtbe tuplss is the degree . 



■.ji ? t,^-- -;,=- -V/^ : ( ,r»; :; jf j-fc^; . : ^ ^ ^■^rg*^^^. 
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S. is a finite set of punctuation signs; 

&i (fiJPi) is a set of sentence predicates whose union will 
be defined to be the language specified by the 
canonic system. 

^i-1 * s t * ie t, °' ) J ect,f canonic system. 

This definition is not complete until we say what the canons, 
variables, predicates are and what we can do with them. 

However, since the reader is assumed to be familiar with these 
concepts, these will not be repeated here. Most of the differences 
have been outlined above, and a formal definition, using second- 
level canonic systems, will now be given. The reader is urged to 
compare it with the old definition of canonic systems [Donovan And 
Doyle 1968, pp. 10-18] , to get a complete and accurate image of the changes 
that were introduced. In order to facilitate the comparison, our 
exposition will also be given by way of an example, and will use the 
same example, a canonic system defining the set of numbers composed 
of the digits 1,2 and 3. Moreover, the drawing on page 5 of the 
above-mentioned work is presented below in a updated form as Figure 2 
to provide a quasi-pictorial representation of some of the changes 
introduced. Gener§l canonic systems are defined similarly, but 
allowing arbitrary concatenations of variables and symbols not only in 
the conclusion but also in the premises. 
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where 



5 = (C x , Vj , M x , P 2 , S x , D x , C ) 

C T : I — 1 digit 

I — 2 digit 

I — 3 digit 

x digit j— x number 

x digit ; y number I— yx number 



V i = { 1 , 2 3 3 } 



M - { x , y } 



^ = ^ digit , number } 



D = { number } 
1 ' 



£ = ( #, #, #, #, #> -er, * ) 



The following parse of the fifth canon of this system illustrates 
the metalanguage used to describe canons . 



p^^1g%s^3^^>^-" - - ..-. r-v= -./-r^;-.;-;- -, ; ?>^ ■■^^^^-^^t■^-^^^-^^^^-Y*>:'• 1 ^^^"*;«=■ -*-- ,^^«k-~-*¥*-.^ 
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digit 



cone, of var. 



y number I-— 

i 

variable 



coac. of var 




number 




e var}jblc 



variable or word 



p-term predicati 




?***?>*• 



variable or word 

^BBBSSSSSSSSSCfSSSSSSSSSSSmSi 



cone, of var. & words 



p-tcrn pr edicate 

\/ 

prcalae 




list of pramieee 



cone* of var. & words 

TVCT'rH !, % i l l assar 



of legal cation format 



term predicate 




Figure 2 



;iJ?»^3JT"T^^c^r^7?T^T?TS .£V*-;sJ~: _fl>' .;.;,a 



12 



The second-level canonic system is a 7-tuple 

tz » (C 2 , V 2 , M 2 , P 2 , S 2 , ^f x ) 
where 

C 2 = { the canons listed on the following pages } 
V 2 = { 1, 2, 3, digit , number , x, y, ; , (— } 
M 2 ■ { q, r, s, t f u, v, w } 
P = { predicates as defined in ..the cahons } 

S 2 " * Ji »(*#<*■>.< ) 
D. » { legally defined string } 
& is the first -level canonic system 

The canons of the second level must formally define the 
metalanguage and operations of the first level; these canons are 
presented on the following pages with a brief discussion of the 
motivation and use of some of the canons. The particular manner 
in which we have constructed the second- level canons system 
allows this system to define other canonic systems with only 
slight modifications, which include, mainly, canons which 
define the set of canons of the system being defined. 



(1.1) 



■*1 symbol 



(1.2) [—2 symbol 

(1.3) ""»3 symbol 



(2.1) 



UBL 



^f^-^^^^^^ j m^m^-:^'^:' 



^C^a^.**^^;?^ 
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13 



2.2; 

:3.i; 
.3.2 

A-V 

4.2: 
;4.3; 
5.1: 

;s.2 

]6.1 

;6.2; 

6.3 

!6.4; 
6.5: 
6.6; 

!6.7; 

;6.8; 

6.9 

7.1 

7.2: 

:8.i 

!8.2; 

8.3 



x variable 

y variable 
hss: digit predicate 
t=» nuaber predicate 
nuaber 

X word ( X is the null string) 

u symbol ; ; v word hat uv word 

u variable fwu concat, of var . 

u concat. of var . ; ; v friable Ja? uv concat. of var 

u concat r of var . js» u p-term 

u word j^u p-tera 

u variable |*u concat. of var. S words 

u word }»u concat. of var. S words 

u concat. of var. 6 words ; ; v variable |» uv concat . 
of var. & words 

u concat . of var « S words ; ; v word |"» uv concat . 
of var. 6 words 

u fffifft, ff'VMTt ft ™M$9 K u iSEE 

t p~term ;; u pyefliy^y |g t|i premise 

t term ; ; u predicate jar tu statement 

X list of premises 

u list of premises ; ; v premise Jsruv; list of prem. 

x lift ? f JtftTffW? 



P^v-^^ ^ ^-ttt^t:^^ ^.- >- - ^ Tl*g 3B^ J E^K g ^ ^^ -fo 
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(8.4) u list of statements :: v statement ^ruv: list of 
statements 

For efficiency's sake, one might add 
(7.0) u premise |* u statement 

(8.0) u list of premises Lc u list of statements 

Note especially the intuitive meaning of p-terin : a p-term is 
either a concatenation of variables or a single word (in V*) . A 
term is an arbitrary concatenation of words and variables . The 
difference between premise and statement is that premise does not 
allow concatenations of variables and symbols (hence it is "context-free") 
while statement allows them. One and the same variable may occur 
several times in the hypothesis and the conclusion of a canon. 
(This is an instance of crossreferencing.) 

(9.1) u word j-g u constant 

(9.2) u predicate A m u constant 

(9.3) u sign psz u constat 

(9.4) u constant ;; v constant f 5 — uv yyigta** 

(10.1) ^s < x < y > differ 

(10.2) < u < v > differ t= < v < u > differ 

The following canons define a set or ordered quadruples named 
substitution . They specify the substitution of constants for 
variables in canons. Thus each canon of the first- level canonic 
system, if it contains any variables at all, gives rise to a class of 
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specific instances of canons. These instances are obtained when 
any terminal string is substituted for the variables in the canon. 

Substitution is defined by a 4-tuple <w < v < s < t > . 
The first element, w , is a word; the second element, v } is a 
variable; the third element is the original nonempty string s ; and the 
fourth element is the string t which results when the word is 
substituted for each occurrence of the variable in the original 
string. 

(H-1) w word ;; v variable |=.< w < v < v < w> substitution 
(1=1.2) w word ;; s variable ;; v variable ;; < v < s > 

differ I— < w < v < s < s> substitution 
(H-3) w word ;; v variable ;; s constant t=<w < v<s<s> 

substitution 

— ^— * — — — — — ■ - 

(11.4) <w < v < s < q substitution ;; <w<v<x<t p 

<w < v < sx < qt> substitution 

Canon 11.1 defines the substitution of a word for a variable 
in a string consisting of only that variable. Canon 11.2 defines 
the substitution of a word for a variable in a string which does 
not include that variable; this substitution has no effect. Canon 
11.3 defines the substitution of a word for a variable in a constant 
string; this substitution has no effect. Canon 11.4 defines substi- 
tution in general . 

Canons 12.1 - 12.5 list the canons of the first-level canonic 
system. 



^C.,,*^^ 
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(12.1) ^>1 digit canon 

(12.2) \= t-2 digit canon 

(12.3) f=* t-3 digit canon 

(12.4) p= x digit f— x number cj 

(12.5) p» x digit ; y nunber \y yx number 

In order to make sure that indeed the canons are of the 
required format, we add: 

(13.0) v gtatgwnt |bk |- v fi£JjJfiyLSJg2SU^g|gg£ 

(13.1) u; W ?f premises ; ; v statement |eu hv of 

legal canon format 

(13.2) u canon :: u of legal canon format |«u instance 
of legal canon 

(Canon 13.3 defines the set of canons in which constants have 
been substituted for some or all of the variables.) 

< 13 - 3 ) u instance of legal canon :: v variable :: 

w Jjord.;; < w f y < u < t > fVfrf^rtVttSP \~= 

Canon 13.4 defines a subset of the canons; this subset is the 
set of all canons which contain only constants. Derivations will be 
generated from "canons with constants." 

(13.4) u fosjanye of j«g n j canop ;; u SQsJafiL j"* 1 
u instance yftft ffflftHft? 
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Canons 14, 15.1 and 15.2 define the sets named constituent of 
and occurrence ; these sets are used in defining derivation . It 
has been stated that a statement can be derived as the conclusion 
of a canon by showing that all. of the statements in the premise 
have been derived; i.e., the premise occurs in the derivation. 
Thus, the meaning of the "occurrence" of a statement in a list of 
statements must be defined. The concept "occurrence" must be 
generalized to show that all of the statements in the premise have 
already occurred in the derivation; this generalization is the 

set constituent of . 

— ■— — - ' ' — '■■- ■■ ■ ■ . 

(14 ) v statement ;; r list of statements ;; t 

list of statements Ur<v rv;t> occurrence 

(15.1) u list of statements ^ < u> constituent of 

(15.2) u list of statements ;; v list of statements ;; 
<u xv> constituent of U< w <v> occurrence j= 
<uw< v >constituent of 

(16.1) X derivation 

(16.2) t derivation ;; w list of statements ;; 
u statement 



;; wf-u instance with constants ; ;<w <t > 

constituent of jag tu ; derivation * 
— — •y mm __= 



* 



The canon (16.2), which also occurs in the definition of general 
canonic systems, is not itself admissible in a simple canonic system. 
In other words, the higher-level canonic systems that we construct 
here are not themselves simple , whether or not they describe simple 
canonic systems. However, it will shortly be evident, using a result 
of Haggerty, that they can be converted to simple canonic systems. 
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The final set to be defined is the set of strings derived 
by derivations; each of these strings is simply the last statement 
in some derivation. 

(17) tu; derivation ;; u statement p* 

u iwmr fatiYfi man- 

Canons 16 and 17 are of particular interest since they define 
the essence of a prsef (derivation) and a J§tf (legally derived 
string) in all mathematical systems. 

This completes the construction of the canons of the second- level 
canonic system. In this example the first-level canonic system had 
only predicates and terms of degree 1; modification to the second- 
level system may be made to handle predicates and terms of higher 
order in the first-level canonic system [Donovan and Doyle 19681 . 

The metalanguage describing the second-level canonic system 
(canon, substitution, derivation, etc.) has not been defined; a 
third level system would be needed to define it formally. The form 
of the third- level canonic system is almost identical to that of 
the second-level system with appropriate changes in notation, i.e. 
predicates are underlined three times and the punctuation signs 
are • ; ; ; ' and • |BE f . We now outline briefly a formation of a 
third-level canonic system for this particular second- level system. 
We remark first that when we specified the second- level canonic 
system, we set up a standard frame, independent of J£ l (canons 
5,6,7,8,9,10.2,11,13,14,15,16,17) to which Gl-fifcPeDdCBt C&DQDS 
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were added: i|. 2, 3, 6, 10.1, 12; The same precedure will 
be followed here. y The third-level ( (i+X) th -lively i*2 ) 
canonic system may be constr^^ 
(i -level) canonic system by the following algorithm: 

1. To obtain the ^ 2 ~ inde P enden t (©^-independent) 
canons, use the standard frame, but make the appropriate changes 
in notation, i.e. underline the predicates one additional time and add 
one more semicolon wherever the sign ';;' (;*) occurs. 

Z To obtain the b 2 *' de P Mdent < ^-dependent) canons, 
use the members of these sets listed in the definition of the second- 
level (i -level) canonic system- as the terms of the appropriate 
canons of the second-level canonic system and underline the 
predicates one additional time. 

Thus, the (i+1) ^-level canonic system can be constructed 
from the i*h-level canonic system with a minimum of effort. Thus, 
it can be seen that all higher-level canonic systems have the same 
basic form. Since no level defines its own operations, each level 
is logically consistent. 

For purposes of discussion, at some level the metalanguage of the 
level must be defined informally. It appears that the second level 
would be an appropriate level to do this. Recall that, for a 
given problem, the first-level canonic system defines the problem; 
the second- level canonic system defines the operation of the 
first-level canonic system. All higher-level systems define the 






20 



operation of previous-level systems. Thus, by selecting the 
second-level to informally define the metalanguage, the first 
level canonic system (which defines the problem) is precisely 
defined and logically consistent* 

For the case when the "object" canonic system Wj is not 
a simple canonic system, the following changes will have to 
be made in the second-level canonic system Q~ formally 
specifying "the anatomy and physiology" of fcj! 



1) 6.1-6.4 7.1 8.1 8.2 are unnecessary 

( 6.5-6.9 7.2 8.3 8.4 alone will do in this case); 

2) 13.1-13.2 should be replaced by 

(13.1) u; list of statements :; v statement L»u V-v 

of legal canon format 

(13.2) u ca*22i;;u 9f Ifttl Wftffl fgptt j 9 
u accepted canon 

3) Obviously, all the (^-dependent canons of (*2 will 

be chosen so as to reflect the particular components of 

Suitable changes may be made to allow for predicates of 
higher degrees. Examples of canons allowed in general canonic systems 



are: 



x A f — ax A 
axby A f— xy £ 
xby A {— xcyd JB 
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x number ; ©x , book descriptor I— x year of copyright 
(x,y €M; ' <3j) f , 'a 1 , f b* , and ' , f are in V) 
The sentence symbol (predicate) will be denoted by ' sentence 1 
instead of ■ £' (D = { sentence} ) . 

The alert reader has undoubtedly noticed another departure from 
the traditional terminology: our avoidance of the term "terminal 
alphabet". The set V has been called just plain "alphabet 1 *. The 
reason is that this set does qq£ necessarily correspond to the 
terminal alphabet of a formal grammar; it may include auxiliary 

* 

symbols. In this connection, see also Chapter VI. 

Before we study the different hierarchies of canonic systems, 
we wish to mention several results of Haggerty and to point out one 
of their implications. 

Th§2rem_H«l. Any canonic system can be reduced to one in which no 
predicate~has~degree greater than 1 . ["Reduced" means that a state- 
ment is provable in the second canonic system iff it is provable in 
the first one,] 



In constructing canonic systems to correspond to regular or to 
context-free grammars, Doyle took the terminal alphabet of 
the grammar to serve as alphabet of the canonic system, and the 
nonterminal alphabet to serve as set of predicates. When, however, 
he considered grammars of type car 1, using a completely different 
approach, he correctly u^d, ^ n fast* the union of the terminal 
alphabet and the nonterminal alphabet of the grammar to be the 
alphabet of the resulting canonic system, but he said he included 
only the terminals. If in his construction the alphabet is to 
include only the terminal symbols of the grammar, then his construction 
would not yield a canonic system at all, since some of the "canons" 
included are of the form f— A nonterminal , where A is neither 
a symbol nor a variable. Whenever we shall hereafter mention these 
constructions, we shall assume that the appropriate correction has 
been made. 
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[Proof by replacing n- tuples < s-^ s 2 «... «s > by terms of the form 

sT?s"$...$s , where $ is a new lymbSl, to bemused as s separator.] 
1 2 n 

Theorem M H*2> Any canon using indicated context may be reduced to a 
canon"wftBut indicated context (in other words, any canonic system can 
be reduced to a single canonic system) . 

[Proof. Each constant word will be replaced by a variable whose value is 
specified (by an additional premise) to be in an [adequately defined] 
singleton set.] 

Theoreg H^g. Any canonic system can be reduced to one in which each 
canon^Raa^ir single premise . 

[The proof uses the following bssic idea: a canon like 

terti^ pred t ; tert^ pred ; ; . . . ; term n pred^ [- term pred 

is replaced by 

<tem 1< terw 2 ^... < term n > M^ lf2 ,.. .,n f~ tem *^ 

where pred , „ is a new predicate whose degree is the sum of the 

r l,2,..«,n 
degrees of pred , and then additional canons are introduced for the 
newly- created predicates*] 

We remark that, as s consequence of Theorem H-2, Jb5_£l*M_°f_Si?Ei5 
canonic systems is no ^^Z^^^^l^S^^f^Sliii^2^Si^Iil^S^Sl!lS 
systems. Knowing this, one might wonder why bother to defined simple ca- 
nonic systems if the class of aets definable by the* is not different 
from the class of sets defined by the most general canonic systems. 
However, the real significance of this theorem is quite different: we 
should study simple canonic systems B fl lifiitt l L frS ffl Wit th * y form * res ~ 
trlcted class of simpler canonic systems which still realises the same 
computational power. An additional argument ia that Alsop' a "canonic 
translator" [Alsop 1967] uses only "simple canons". Moreover, there is 
nothing to guarsntee us that if we apply a certain restriction on the 
class of all canonic systems and on the class of simple canonic systems, 
the resulting classes have the same computational power, or that the 
image of the first restricted class under the trans formation of Theorem 
H-2 is included in the second restricted class. 
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A HIERARCHY OF GENERAL CANONIC SYSTEMS 

Canonic systems were first used in specifying the syntax of simulation 
languages [Donovan 1966], including the features trtnich cannot be expressed 
in Backus-Naur Form. Since canonic systems, while designed to be more po- 
werful than BNF, were too powerful when first defined (having the full com- 
putational power of Turing machines and thus being able to define non- re- 
cursive sets), it was felt that restrictions have to be applied so as to 
render the resulting classes of canonic systems incapable of defining non- 
recursive sets yet powerful enough to specify the syntax of any programming 
language. (Experience and intuition have indicated to us that for most pro- 
gramming languages the set of legal programs la recursive and It is only 
specialised features of languages such as those found In PL/1 which have 
enabled us to prove that the set of legal PL/1 programs is not recursive 
[Hand! 1969a].) This was the motivation for studying hiS5££5h*S5_2£_£«5^ 
nic^sys tenas . Doyle, in his Master's thesis, picked up this line of re- 
search and defined a partial hierarchy of canonic systems, trying to in- 
clude in it correspondents for Chomsky's 4 types of formal grammars. 
Doyle's hierarchy has two distinct parts. The first part includes two 
classes of canonic systems, one equivalent in strong generative power to 
regular grammars and the other equivalent in strong generstive power to 
context-free grammars: 

1 ^gSESB ..Sui 3 I" 3 " f « "Type 3"]. The class of right-linear canonic 
systems and the class of regular grammars are strongly equivalent. 



Theorem!)^. The class of normal- form two-premise canonic systems 
and the class of context-free grammars are strongly equivalent. 

There was a clear correspondence between the two formal systems, to each 
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production in the grammar corresponding a canon in the canonic system, and 

vice-versa. All the predicates occurring in the canonic system were of 

degree 1 (sets of strings), and the canonic systems turned out to be, 

in our terminology, simple canonic systems. In the second part of his 

hierarchy, Doyle allows predicates of degree 2 to occur (sets of pairs 

of strings) but no predicates of higher degrees, and obtains a class of 

canonic systems equipotent to Turing machines: for any grammar of Type 

there is a canonic system which generates the same language. In other 

words , 

IbgglgnkJhQ • Tne class of canonic systems with predicates of degree 
2 is weakly equivalent to the class of Thue semisys terns (grammars of 
Type 0). 

From the proof of this theorem we also have: 

Theorem_D-0s . The class of simple canonic systems with predicates 
of degree 2 is weakly equivalent to the class of Thue semisystems. 

Doyle also mentions "noncontracting canonic systems with predicates 
of degree 2", and states that these canonic systems generate only recur- 
sive sets and that for any given context-sensitive grammar one can find 
a "noncontracting canonic system with predicates of degree 2 ,r weakly 
equivalent to it. We have not listed this as a theorem since the defi- 
nition of "noncontracting" is entirely inadequate, especially when pre- 
dicates of degrees 2 (and higher) are included, and therefore the 
above-mentioned class cannot be considered to be defined. In this con- 
nection, see also Chapter V. 

This completes the second part of the hierarchy. The one-to-one 



correspondence between the productions of the formal grammars and the 
canons of the corresponding canonic systems* while present in the first 
part of the hierarchy, could not be established in the second part, 
owing to the inherent difference between canons of these classes of 
canonic systems and the productions of Tl or TO grammars. If we direct 
our attention to canonic systems which do take context into consideration 
(canonic systems with indicated context, which are here called 'general 
canonic systems'), a natural solution presents itself which not only 
fills in the above-mentioned gaps but actually brings about strong equi- 
valences with all 4, types of formal grammar a considered by Chomsky and 
with any type of grammar definable in term* of productions, thus embedding 
StS-S!}52 r Z- of forM l graasoars into that of canonic systems. This simulation 
of formal grams rs by appropriately restricted canonic systems with indi- 
cated context is the object of the present chapter. 

The following definitions are analogous to Chomsky's: 

P?--?iSi2?-2 • A canopic system is called 5;Sonic_system^f_Tvj>e_0 
if each of its canons, except for five of them, is of one of the forms 

(1) xfAyy- definable J- s^fy ■ afrlgfrfr 

(2) A nonterminal 

(3) a terminal 

where 

(«) to»U/, a) denote particular springs* powibly empty; 

<b) A is a nonterminal (i,e* there is a corresponding canon of 

the form (2) ) ; and 
(c) for every symbol from the alphabet there is either a canon of 
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form (2), or a canon of form (3) (but not both) , 
the ftVe other canons being 

(4) |— V derivable (£ CV ) 

(5) I— \ terminal string 

(6) x terminal U— x terminal string ( x , y £M ) * 

(7) x terminal ; y terminal string L xy terminal string 

(8) x derivable ; x terminal string I— x sentence 

We may dispense with the predicate ' nonterminal ' altogether, and 
replace the present requirement (c) with a new one, <c f ): 

(c 1 ) Any symbol in the position of A in a canon of form (1) ** 
must not appear in a canon of form (3) * 

Since this modification will simplify the proof of the main equivalence 
theorem, we shall adopt it. 



* The effect of applying Canon (6) in a derivation can be achieved 
by applying Canons (5) and (7), Canon (6) was retained in order to pre- 
serve the correctness of future references >y:ftMtMl« nutoberi 

** There are two ways in which a canon like 

xABCy derivable L~ xABACy derivable 

may be interpreted as a canon of form (1): 

1) <2>- A ; y= C; a) - BA ; the expanded letter is B 

2) Q> « AB ;y= \ ; a) * AC ; the expanded letter is C . 

(Of course, this is Just one canon, not two, and the two interpretations 
have no influence on the use of this canon in derivations.) win such a 
case, only one of the symbols that may be considered as being "the expanded 
letter" is requied to be a nonterminal (i.e. to be miaaing from the canons 
of form (3) ). 



'■~.£>$&i&^;?3&^£y-> -r>\-..->- :■-»!■ .-,y,r->J.: 
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??#JPi*i?P_3. A canonic system is called a canonic^ system of 
TjfES_l or S2D?S??z§?5§i?iyS.£§D2Dl£-§if55S , B (CSCS) if it is a canonic 
system of type satisfying the additional condition that in all its 
canons of the form (1) the string a> is non-null. 

P??lPl5i9P-* B A canonic system is called a canonic jsystem of JType 2^ 
or context-free canonic system (CFCS) if it is a CSCS satisfying the addi- 
tional condition that in all its canons of form (1) the strings <p,ty are null, 

9s£iPiJ*9!L§* A canonic system is called a canonic s ystem of Type 3 
or regular. canonic. §y§ tern if it is a CFCS satisfying the additional condition 
that in all its canons of form (1) the string w contains just two 
symbols, one terminal and one nonterminal (one for which there exists a 
canon of the form (3) and one for which there is no such canon), always in 
the same order. If the order is "nonterminal - terminal* the regular 
canonic system is also called a ^eft-linear canonic system. 

The definitions for linear, one-sided ljn§§r, S!§talinear, 
sequential, etc., grammars can be similarly imitated, and so we can speak 
(9g£lDiSlon_§) of linear, one r sided linear, 5§talinear, seguential, etc., 
?????*£ ?y?£??5* Obviously, all results obtained for these types of 
grammars hold also for the corresponding types of canonic systems. 

Ibsersro 1 £21 -SYSIXJlffi? -1.2522312.^ 
l§-Sjto2_l-SI55KJ_which_gen^^ 

2£her_words 1 _the_class_of JT^ 

2f-lYB5-i.£SS23i£-S^25!5-f25-i--.2i t .li,-2 l- 3 L 

We shall show how one can pass from grammars to canonic systems and 

from canonic systems to grammars. Let there be given a grammar G * N, T, P, I) 

of Type i (i = 0, 1, 2, 3). The associated canonic system has the canons (4), 



*& >-., , y ^J* ^^ ; £!=rr^?"^^ * ^.#ff ^ - : ■ A- TT^vCTryar^s^ 
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(5), (6), (7), (8), one canon of the form (3) for each element of T, and for 
each production <pA ty ■+ <p a) i> one canon of the form (1). The resulting 
canonic system is, by construction, a canonic system of Type i (i = 0, 1, 2, 
3); the strings (p, ty may be empty. Suppose now a canonic system of Type 
i is given; the corresponding grammar is defined in, the following manner. 
The set T includes all symbols for which there is a canon of type (3) ; 

N will include all other symbols and for each production there will 
be a canon of form (1). It is obvious that the resulting grammar is 
by construction of the same type as the canonic system from which it was 
derived. 

Before we show how derivations are simulated, we should clarify 
what is meant by a derivation in formal grammars. Two definitions are in 
use in the theory of formal grammars, and our construction below works 
with either of them. According to the first definition, any sequence of 
applications of productions constitutes a derivation of the string obtained 
at the last application; a string is accepted iff: 

a) it has a derivation; 

b) it contains only terminal symbols. 

According to the second definition, a sequence of applications of productions 
constitute a derivation only if no further applications of productions are 
possible. The grammar is usually required to have for each nonterminal 
symbol, at least one production expanding it, in which case a derivation 
produces automatically a string of terminals (if there were a nonterminal 
in the string, the sequence could be continued and therefore does not 
constitute a derivation); a string is accepted iff it has a derivation. 
We shall use the first definition, but we remark that if the grammar 
is required to have for each nonterminal symbol at least one production 
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expanding it, a derivation in the first sense (according to the first 
definition) is also a derivation in the second sense (i.e. cannot be 
continued) iff its last string contains only terminal sytabols, and so 
the two concepts of acceptance coincide. 

Let us consider a derivation in the canonic system. We shall 
simulate the derivation in the canonic system, in a step-by-step manner, by 
a derivation in the formal grammar. Without loss of generality, we may assume 
that the derivation in the canonic system starts with the canon (4). The 
derivation in the formal grammar simulating it will start with the oner 
character string Z , Any canon of the form (1) will be simulated by means 
of the corresponding production; canons of other forms will be disregarded 
for the moment. We have thus obtained a derivation in the formal grammar simu- 
lating step-by- step the given derivation in the canonic system. If, the 
last string obtained is not only derivable but also a sent ence, then this 
string has been obtained by applications of canons (5), (6), (7), with a 
final application of canon (8). ^^applicability of canon (8) proves 
that the second condition for acceptance in formal grammars (condition 'b)' 
of the first definition of derivation) is fulfilled, and therefore the 
string is accepted by the formal grammar. 

Therefore we have shown that for every derivation in the canonic 
system there is a derivation in the grammar. The converse result is proved 
similarly. This completes the proof. It is easily seen that what we have 
proved amounts to strong equivalence. We can therefore assert: 

(strong form of the general equivalence theorem) 
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Special, typeg.gf.cgntext-sen^t^ 

Definition.7 A canonic system is called a lsf£rS0tttfi2t=S§DSi$iY§.e§nQnic 
§Y§£§!5 (1CSCS) if it is context-sensitive and in all its canons of type (1) 
the right context (the string <;) is empty. [And similarly for rCSCS. ] 
These definitions are the natural counterparts of the definitions for left- 
.context-sensitive, [right -context -sensitiv^ grammars. One-sided context- 
sensitive grammars have been studied but with no significant results to date. 
About all that is known is that they can generate nori-CF languages (and cannot 
generate non-context-sensitive languages). It is conjectured that they 
cannot generate all context-sensitive languages. 

Another type of formal languages (left«*tontext-sensitivd have 
been defined in Mandl 1968 and shown to be weakly equivalent in generative 
power to context-sensitive grammars. This gives rise to a new type of 
canonic systema^trongly equivalent to leftJfcontext-sensitiVs grammars. 
These grammars seem to be new and interesting and therefore we will 
discuss these further here. 

The definition below was suggested by Booth's definition of 
context-sensitive grammars [Booth 1967] as a phrase- structure grammar all 
of whose productions of any of the following three forms: 
(9) Cl A C 2 - C x C 2 « 

(10) q A5 2 + w C x C 2 

(11) ?! A C 2 + C x w C 2 

He further remarks that productions of the forms (9) and (10) are not really 
necessary (since they can be obtained by adding f few rules of the form (11) 
and by adding a few new nonterminal symbols) but they make his exposition 
easier to follow. Suppose now that the right contexts are null in all 
these rules (and similarly for left contexts). Then the rules have the form 



J^^-t^^SSBfcfcfc^^ 



31 



C x A + ? x (o 



0) 



C x A -► C x u> 
where the first and the third are left-pontext-sensitive, rules and the 
second is not. This second form of production will be the only form 
allowed in the grammars we are going to define. 

Def init ion^S . A 1 ef t - Vontext- sens it ive^ grammar is a phrase- structure 
grammar all of whose productions except perhaps for a rule I + A , 
are noncontracting productions of the form 

(12) <pA + moo , A e N, <pe V* - (N(jT)*, U) t A. 
[Similarly for right-*context-sensitive grammars] It may be remarked 
that this type of production is 3Qt a particular case of the general 
production (nk ty "-► ^oj ty as the left -^context -sensitive rules were. 
Likewise, the corresponding type of canon is not a particular case of 
(1), and so we cannot (yet) define left-*/context~sensitive^ systems as 
a special case of Tl (or Type 0, for that matter) canonic systems (see 
footnote). We shall use instead a definition which is similar to 
Definition 11. 

Def initlor^}. A J«ft-*j wnt^^ is « 

canonic system which includes the particular cmons (4), (5), (6). (7), 
(8), a finite number of canons of the form 

(14) x&Ay derivable {— - xt*)«y derivable 

and one canon of form (3) for each symbol A occurring in some canon 
(14). [Similarly for right-*, context-sensitive, canonic systems; (14) 
la replaced by (15) xAy/y derivable [^ xyfay derivable •] 



"s^ES^^Tp^ 'lp£*^ 
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Theo rem 2 . For any given context-sensitive grammar^ there exists a 
Jeft-^context-sensitwe^ g jamar _ _(a_ r i gh t - *£ont ext - sens i t iye*. z . }_ gener at in j 
the same language and obtainable from the^ original one b^ a uniformly 

Proof. The proof will make use of certain reductions [Kuroda 1964] 
but it will be evident how to start the proof should one wish not to use 
the reductions. Definition [Kuroda] A context-sensitive grammar is 
of order n if there appears no string of length greater than n in any 
rule of the grammar. Lemma 1 [Kuroda] For any context-sensitive grammar 
of order n (n > 3) there exists a context-sensitive grammar ef 
order n-1 generating the same language. 
(By repeated use of Lemma 1:) 

Lemma 2. [Kuroda] For any context-sensitive grammar there is a grammar 
of order 2 equivalent to it. 

Let G be the given granmiar. By introducing new terminal symbols, 
we can convert it to an equivalent grammar in which terminal symbols appear 
only in rules of the form A ••■ a ("terminal rules") . 
Remark. [Kuroda] The original grammar might have been given in an 
apparently more general form* in which there might be a production which 
rewrites more than one symbol: 

(16) a) r ^ w 2 / K' - K 

w 2 t frt*N)* . N(TUN)* 



*We can thus define two new types of canonic systems ("Types P and 0* ") , 
with canons (4), (5), (6), (7), (8), canons of the farm (3) (and (2)) and 
canons of the f orm 

(17) xa^y derivable I — - xauy derivable 

where w^ includes at least one nonterminal, with or yitbOUf the restriction 
|ctfj| S |w 2 l • u si n g Kuroda" s remark and our general equivalence theorem, we 
can conclude that these types of canonic systems are weakly equivalent, 
respectively, to Tl and TO canonic systems. At this stage we could redefine 
left-*context-sensitive canonic systems as a certain special case of 
Tl 1 (context-sensitive) -canonic systems. 



^>;33£^&?»^^ 



Using the general equivalence theorem, we have: 

Th eorem 3a . For any given lef t-*context-sensitive grammar there is 
a left;%ontext-sensitive_canonic ^system^strongly^eguivalen^to^it.^and 
conversely. The class^of lef t-^context-sensitiye, gr «™ars_is_8trongly 
equivalent to the class of left-*context-sensitive. canonic systems^ 

Theorem 3b. For any given context-sensitive grammar (canonic 
?X5£?52.£-S!:5_*?-?-lS?!:l*€25£^^ 

&en^itiye_gram^rs_£^ 
2f.iSi£l5S225S55lSKSi5iyf'-Sf?22i5-5y5S?M-i5FSS??Sli 

Similar theorems hold for right-*pontext-sensitive, canonic 
systems and grammars. A further application of the general equivalence 
theorem yields: 

Tfoeor em 4. For any given context-sensitive canonic system there_is 

?-l5££l*€22!:55£l?225i!:iY2u2??25^^ 
converse is trivial. £ 

strongly 
«.».■-» .... ■ ■ CONTEXT-SENSITIVE 
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CM \ t4 «**^^ * • _-< <f I ** ■ 
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strongly 

[Th. 3a,] Th. 1 
Figure 3 
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Most of the equivalence theorems of this chapter are summarized 
in Figure 3. For completeness 1 sake, we also included several trivial 
results. 
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CHAPTER III 

SyBRECUR§IYE.CLAS§ES.OF CANONIC .SYSTEMS 

Both these hierarchies of canonic systems, as well as the hierarchy 
of formal grammars, have no class of system to correspond to the class of 
recursive sets. ("Noncontracting canonic systei»with predicates of 
degree 2" were claimed to be situated somewhere between context- 
sensitive sets and recursive sets, both inclusions being in the weak 
sense.) 

We state here in what sense(s) would a class of canonic systems 
(formal grammars, etc.) correspond to recursive sets and elucidate 
why no class of system has been found equivalent to recursive sets. 

It is well-known that there can be no procedure for deciding 
whether an arbitrary recursively enumerable set is a member of a 
given non-empty collection of recursively enumerable sets, except 
in the trivial case when all the recursively enumerable sets are 
members of the collection. This is Rice's theorem; see, e.g., 
Rogers [ 1967 , p. 324 (Th. 14-XIV (a) )] .Consequently, it is clear 
that we cannot hope to find a class of canonic systems which (a) defines 
all recursive sets, and only recursive sets, and Q>) the class includes 
all the canonic systems which define recursive sets. 



[Mandl 1969b] 



'"., - \:-:9r --.->rJ ?■„■ *■-<:■ j%F'T: ";' " *«?-'* 



(a] 
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We might hope that there exists a "small" class of canonic 
systems which define all and only recursive sets however realizing 
that the class cannot include all canonic systems which define 
recursive sets. Or, stated in another way, it might be the case 
that a certain class of canonic systems (characterized by a finite 
set of properties, and such that is is decidable whether a given 
canonic system meets those properties) , would correspond to the 
recursive sets in the sense that 

•only recursive sets are generated by canonic systems of 
that class (the class is "subrecwrsive") ; 
-for every recursive set, there is among the canonic systems 
of that class at least one canonic system defining the 
given recursive set (and there may be such canonic systems QUtsidS 
the considered class) . 
We shall prove that such a class cannot exist, i.e. if a class 
of canonic systems defines only recursive sets, then it cannot define all 
recursive sets, even if it does not have a monopoly in defining recursive 
sets. This result can be restated succinctly as: "Subrecursive classes 
of canonic systems are strictly subrecursive." 

formal systems, for that matter ) xan correspond exMtl£ ^^J^j^^jjf 
(a) above) to the class of reovsij^e s^^. to , BC5T1 £^» 
[ Recursive.ssts} * . 



*The reader may have noticed a similar statement, without prppf, in Donovan 
and Doyle, 1968, p. 46 1 f Th*s, a noncontracting canonic system can only define 
a recursive set. However, it cannot define all recursive sets; some 
recursive sets can be generated only to a TO grammar.". An earlier work 
claimed to have proved this by exhibiting a concrete example, but the 
proof was eliminated when the emaaple turned out to be a context-sensitive set 
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CXQQf (based on an idea of Hopcroft and Ullman [1969 , §8.3] )♦ 

Since canonic systems are finitely specified, we can canonical ly 
enumerate all canonic systems, the canonical index encoding the 
whole description of the canonic system ("G$delization" of canonic 
systems,) Likewise, we can canonical ly number (encode) all the words 
over the denumerably infinite list of potential symbols; let 
0)^ be the k th work in this numbering. Since it is assumed decidable 
whether a certain canonic system is of this type or not, we can strike 
out all the canonic systems not-Qf-this-type* thereby effectively 
enumerating all the canonic systems of the type considered: 

£ * £o> S.» ••• • B Y the hypothesis, all these canonic 

1 f Jt m£ 

systems define recursive languages ^l» 2» 3 ••• • Consider 

the set 



It is different from all ^±> * x l > 2 > ••• J yet it is recursive. 
Therefore no type of canonic systems can define all and only recursive sets. 
Remark. A recursion-theoretic argument yields Theorem 7 as an immediate 
consequence of the known theorem that the class (set) of all recursive 
sets [ while recursively enumerable as a class of r.e. sets [Blum 1965; 
Suzuki 1959 His not characteristically enumerable, PlQGf.Qf.tbS-IS&KtiQB- 
For all subrecursive classes of canonic systems the proof of the subrecursive 
ness has been done by exhibiting a decision procedure. In other words, 
if we have a finite description of a canonic system, we can interpret 
it not only as giving a procedure for enumerating a set but also as giving 



^$^ff^t^^^^^^^S^^^^^MfL : -W^^s^ 
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a procedure for computing the characteristic function of the set, i.e. 
that we can find not only an r.e. index of the generated set but also 
a characteristic index thereof. Therefore fa description jfo*\jl 
canQnic-system-belougiDg-to-a-Subrecursiye.class.is-alcio-tQ-8-cbaracteristic 

iDd§x_fQr.the.rgciii§iye.§§t.4sf ioed.by.tbat.safiQBis.systssi^ 



♦The elucidation of this point owes much to a discussion with Professor 
Patrick Fischer and Professor Juris Hartmanis ait the Third Princeton 
Conference on Information Sciences and Systems in March 1969, 
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CHAPTER IV 



CANONIC SYSTEMS FOR CONTEXT-SENSITIVE SETS 



In Chapter II we mentioned Doyle's work on a hierarchy of canonic sys- 
tems, where, inter alia, it was stated that the NCST were situated some- 
where between context-sensitive sets and recursive sets. Let us now take 
a closer look at the definition of NCST. It reads ("Definition 2 . 13") : 

"A noncontracting canonic system (NCCS) is a canonic sys- 
tem in which each application of a canon results in the length- 
ening of the string denoted by the predicate defined in the 
canon. That is, if A $P and a) « A and to prove o)«A it 
was first necessary to prove f3 « B , then /ojj>|pl . That is, 
in a derivation, if we have 

II . . '•• ; P ^ 5 -.- ; co A ; ... 
then |U)|^p|. ( B may denote the same predicate as A ) 

A noncontracting canonic system with predicates of degree 
two (NCST) can be constructed to describe the language gener- 
ated by a Tl grammar; this canonic system has the same basic 
structure as the canonic system equivalent ot a TO grammar 
with the additional length restriction." 

9-J?:££*? n 5L-? tne definition 

lm "£*}e_string denoted by the predicate defined in the canon" . The 
conclusion of a canon has only one statement , and therefore it involves 
exactly one predicate. However, this predicate is not necessarily of 
degree 1 , so we cannot refer to "the string". 

2. "lengthening" . That unspecified string is longer than something. 
Longer than what? The hypothesis of a canon may include many strings and 
many n-tuples (tuples) of strings. 

3 * " M>(9| " • If w and P are tuples, their length is unde- 
fined. If they are strings, then something has to be said about tuples, 
or at leastabout pairs, since predicates of degree 2 have to be allowed 
in order for Doyle's proof of [Type 1]£ [NCST] to work. 
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4. [Concerning the derivation] Although on p. 18 of that paper it 

was said "In this paper, a derivation will consist of a sequence of canons 
instead of the sequence of conclusions of these canons", here we have to 
revert to the original definition of derivation (as sequence of conclu- 
sions). When we do so, we see that an axiom may appear anywhere in this 
sequence, and it is not necessarily longer than all its predecessors (or 
shorter than other strings that may follow). Moreover, not only strings 
appear in a derivation but also tuples. 

5. "( B may denote the same predicate as A )" . B does not denote 
a predicate; rather, it is a predicate. Formally, predicates are and 
remain elements of P ; and when we write P - \ A , j| we also mean that 
A and B are different elements of P . We could have introduced meta- 
variables ranging on predicates, " !£ , l£ , ... » - ln "X* thc Bam way in 
which we tacitly introduced p , gj , (f » if/ to stand for particular 
strings, and in that case we could have written 

• ••; P .!£;••• » w **% i ••• 

and said that the meta-variables 1^ and 1^ may denote either two 
distinct predicates A , B or one and the same predicate A . Since we 
have not introduced such "predicate-variables", and since A , by defini- 
tion, is not the same as B » one should have said 

"... if we have . . . ; p B ; . . . ; w A ; . . . 

or we have ... ;P A ; ... ; to A;... 

then Mfcfpl . " 

We therefore see that, at this stage, there is no such thing as non : 
contracting^canonic^systems^with^ . Correspondingly, 

this chapter will be devoted not to proving something about the [undefined] 
NCST but rather to finding^definition which will be intuitively acceptable 
and will be such that 

1] Doyle's claims will hold for it ( [Type l]fi [new class] £ [free] ); 
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As it very often happens in such cases, the reel problem is not to 

prove but to "gi£**l\jNtat J:o_grove («** to "improve a bad guess" by trie! 
and error) • 

We cannot define 'noncontracting' Inc] as "such that the sum of the 
lengths of all strings in the hypothesis (Aether appearing isolated or as 
elements of tuples) is at most as large as the sum of the lengths of all 
the strings in the conclusion" ., since then a canon like 

x A ; x B f— x C 
would not be noncontracting, which is not only counter- intuitive but also 
does not allow us to salvage the proof for "[Type 1] g [NCST] ". For 
the particular case when no predicate of degree 2 appear in the conclu- 
sions of the canons, one could try 

"the string in the conclusion is no shorter than any of the 
strings appearing in the hypothesis, whether they constitute 
terms of degree 1 or are elements of higfcer-degree terms" . 
We shall reconsider this suggestion later on (in a modified form); at 
the moment we have to abandon it because we plan to use as much as pos- 
sible of the existing proof [Donovan & Doyle 1968, pp. 43-44], arid the 
canonic systems constructed in this proof are, aa we noted in Chapter II, 
general canonic sySteM^with^predicates^of^egree^^ (slab ito the conclu- 
sions of the canons). 

Since the real problem here was the finding of of a good definition, 
we think it would be more instructive for the student of canonic systems 
if we try to present how^the^definitton^jws^arrlyed^at, instead of just 
exhibiting it and showing that it works. 

Doyle's proof of the recursiveness used a multitape Turing mschine; 
the idea was to show that this machine always halts, thus deciding mem- 
bership in L( £ ) . We intend to p trove more, vie. that the set L(£ ) 
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defined by the canonic system is context-sensitive. For this, it will 

be enough to show that the multitape Turing machine which decides whether 
w £ L( £ ) never uses more than |cp| squares on any of its tapes. 

As our first step, we modify Doyle's Turing machine to have, in 
addition to one tape for each predicate of degree 1 , also k tapes 
for each predicate of degree k , for k « 2, 3, ... (all the tapes are 
distinct). In Doyle's construction, the Turing machine exhaustively ge- 
nerated all strings of length ^ |o)| in the language defined by the ca- 
nonic system, and checked for the occurrence of u> on the tape assigned 
to the sentence predicate. Naturally, all strings, on all tapes, had to 
be placed one beside the other (separated by special characters), and so 
the storage space for far from being linear. One could achieve linearity 
if each string replaces the contents of the tape on which it is placed, 
instead of being appended (with a separator) to the current end of the 
tape. However, each string has to stay available indefinitely, for later 
use in derivations (Fig. 4). 




[Other com- 
putations] 



Figure 4 
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More exactly, it has to stay Indefinitely available in all cases EXCEPT 

when each canon has at most one premise (if premises, the canon is an 

axiom), in which case (see Fig. 5 )> 



I (axiom) | 



/ 






r*— — i 
i — -J 



\ 




c__j iz~n 



Figure 5 



each statement on a computation path is used once immediately after being 
obtained and never needed again. This will be the main idea of our proof. 

In order to achieve thi* situation we have to reduce our given cano- 
nic system $ ("of Type X") to one (Jy in which canons have at most one 
premise and which is also"of Type X" . Forgetting for the moment of the 
f, Type X" restriction, we notice that such a reduction is always possible: 
this is one of Haggerty's results (Theorem H- 3, here). There are exactly 
3 ways in which the canons of £ are constructed: 

1) they may be inherited from £ , if they have at moat one premise 
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2) they may have been included in pj\ to replace some canon 

t l£ red 1 ; ...; t n jn^ j— t Q jjred^ 
o^ tj ; general form: 

< t l^ t 2*'--* t r> £^d 1 £££d 2 ...pred n |_t Q jjred^ 
where the degree of the newly introduced predicate is the sum of the de- 
grees of the n predicates in the hypothesis of the old canon; 

3) they may have been required by canons already in £!. : 
if C has canons 

<t^ *..^t> R I — t R f 
^ 1 * * nr — I o — 

^ t! ... t'> S I — t 1 S' , and R'S T is already in £, 

^1« *n* o —— - ^* ' 

then it will also have the canon 

< t l<"- < fc m< *[«—«*'*> -S H <t o< t o > ^ 
where deg(RS) - deg(R) + deg(S) , deg( R f S' ) = deg(R^) + deg(S^) . 

From here we get the final hint as to how to choose "Property X" : 
if we are to use the method of proof sketched above, "Property X M has to 
be invariated by ^J,^)' . r 3) f suggests the following: 



PROPERTY X . In each canon of the canonic system: 
If the predicate in the conclusion is of degree k , then in each premise, 
separately, the tuple can be decomposed * into k parts (possibly empty), 
which are contiguous, mutually disjoint, and collectively exhaustive; and 
there is a permutation of these k parts such that, for every i ,ltfi<k , 
each element in the i part ** always represents a string which is 
no longer than that represented by the i element of the term [of order 
k ] in the conclusion of the canon. 



* It is understood that no element of any tuple is to be cut in the 
middle by the decomposition. 

** The part which became the i after the application of the per- 



$g^pg$£$&5^^ 



Examples : < x < y> A |"V0t2 4 y3> A£ 

As a particular case, we have: 
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PROPERTY X. . [Same as X. » but only ode of the elements in the 
conclua ion is compared with those in the hypothesis : there is an integer m , 
m$k , such that the m element of the cone lusion a Iways represents a 
string longer than those represented by any dlimvfc ia *t*y term in the 
hypothesis.] 



Example: 



<■*« y> A \~* -<** m. 5 ^ ^ 



We shall now clarify \Aat we mean by the egression 'always repre- 
sents a shorter string 1 v When a canon is used in a derivation it does 
not appear in its general form but as a particular candn_ ins tance » in 
which all the variables are replaced by particular strings. What Pro- 
perties X. ( i - 1 , 2 ) require is that for each canon there be a 
decomposition of the kind specified above and such that for all the 
instances of that canon that_can_ag£Mr_toji^ 

canonic system * the above-mentioned decomposition yield particular 
strings which satisfy the length relationships specified in the defini- 
tion. 



* For example, if a canonic ays tern contains only the canons 

h3 digit 

h5 digit 

x dif it h~ x number 

x di^ it ; y number |— » xv number 

then f 535 digit fr» 535 number ' is a legitimate instance of one of the 

above canons, but can never appear in a derivation* We shall be concerned 

here with canons like 

< X J> greater in length ; y very lon^t string f~ x v^ i n «trin ? 

which are so decomnosable. because anv F pnn*rerit-1vl nff*»nHina fnst-Anro 
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Thus in order to ascertain whether a certain c. a t has Property K ± we 
have to make sure not only that the canons have certain forms but also that 
an infinity of canon instances satisfy certain restrictions* When we talk 
of classes of canonic systems we usually require that membership in the 
class be determined on the basis of a finite set of canons, not on the basis 
of an infinite set of canon instances; therefore we now proceed to define 
properties similar to Properties X ± but such that they involve the canons 
themselves rather than an infinity of canon instances. 

Let us consider first a term of degree 1 » e.g. xaby , where a , b 
are symbols and x , y are vaitablee. Whatever the strings represented by 
x , y may be, the resulting string is always longer than the string repre- 
sented by xxyabb . We shall write: 
yx ^ xaby ^ xxyabb 
Other examples: 

X ^ XX 

x ^ xy 

x ^ xb 
xx3y ^yx 

We have to make one more preparatory digression before we formally define 
the relation $£ . Since we want to use Doyle's construction of a c.s. for 
a given context-sensitive grammar, let us have a closer look at that cons- 
truction. (We want to make sure that the definition of ^ *ill be chosen in 
such s way that the c.s. constructed will have Property X x .) Its "most im- 



<abc„defg> greater in length ; defg yerv long string j~ a be very lonfi string 
, while legitimate as an Instance , can never appear in a derivation in a c.s. 
which defines '«*. y> greater in length ' to mean » x is longer than y ". 
* "c.s." - "canonic system" . 
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portant canon", and the only one which is likely to cause problems, is 

(1) wxz derived string : <x ^y» production : <y ^x ^greater in length J— 

wy« derived string * 

The problem is that we need wxz^wyz , where x , y are not comparable 
(being two distinct variables). All we w$nt is that always the string re- 
presented by y be at least as long as that represented by x , and this 
is ensured by the premise ^v-x* greater in lenth < krldsbc|> . Tti« defi- 
nition will include also this case, thus "legalising" canon (1) . The pre- 
dicate greater in length used above is defined thus: 

(2) x terminal |~- x symbol 

(3) x nonterminal {— x symbol 

(4) f- <\ c 1> l«Mtb 

(5) <x < y> length ; z symbol |- <x« c yl> length 

(6) <x -l y> length ; <z < yl> length \— +* x> greater in length * 

(7) <x,y> greater in length :cy^*> greater in length |^<x^z>Mggz 

ter in length 

(8) <x^v» length ; ^z T y> length |— <x ^ z> greater in length 

Canonic systems which include the canons (2) #..(8) will be called 
length-mbn it or ing_ canon ic^ sys term;. We remark for later use that these ca- 
nons satisfy themselves the requirements placed upon canons of canonic sys- 
tems satisfying Properties X^ X 2 (i.e. they are decomposable in the pre- 
scribed manner). 



* It is because of this canon that the c.s. which include canons (2).-. 
(8) are not simple. The second element of a pair in length represents 
the length of the first element expressed in 1-ary potation: 0- f l*» 3-UIU", etc 
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De f Init ion_ 10 . (Definition of < (with respect to a particular canon 

in a particular canonic system)) 

.la. For any words a , P 

\ 4 a ( \ is the empty word) 

a^ p .«+. I^MpI 
• lb. If x is a variable, then 
\ 4 x 
x 4 x 
.lc. If a premise of the form <v^u> greater in length is 
included in the canon, where u , v are variables, then 

u^ v (in that canon) 

If t- , t« » t„ , t, represent concatenations of variables and words, 

.2a. [ Transitivity! t i < ^ ' c 2 * *3 # "^ *1 < e 3 
.2b. [Side-by-side concatenation of inequalities] 

t x < t 2 . t 3 < t 4 ..■*.t 1 t 3 -..<t 2 t 4 

.3. No relationship t- 4 t_ is valid unless it is deduced from 
a finite number of instances of .la. , .lb. , .lc. by means of a finite 
number of applications of .2a. , .2b. 



With the help of the relation 4 we are now in a position to define 
PROPERTIES Y- , Y~ , for length-monitoring canonic : systems. These properties 
are defined in a similar manner to that in which we defined Properties X- , 
X 2 , but: 

1) the expression 'element *t_ always represents a string which is 
no longer than that represented by t. * is replaced by ' t- 4 t- f ; 

2) the canons (2)... (8) , present in any length-monitoring c.s., 
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are not required to be "decomposable" . [Notice the formal change In the 

concept of "deeomposabiiity".] [We shall later consider other types of length- 
monitoring c.s., in which case »2)» will refer to the canons there used for 
monitoring length.] 

We note that Property Y ± Implies Property X ± ( i - 1, 2), and that 
one can immediately 1 tell, by inspection, whether a c.s. has Property Y 
( i ■ 1, 2 ) or not (this was not the case for Property X. , Property X ). 
This latter fact justifies the following definition: 



-P5fi5iSi25_ii* A length-monitoring canonic system is of Type Y, (res- 
pectively Y 2 ) if it has the Property Y x (respectively Y 2 ) . [The name 
'type' is reserved for properties detectable by inspection.! 

Thegrem_6. 

a ) £--S9..f2 v ..SS2£«*t:2SS2iiiy e .^^ effectively 

£ on 2!:£!? c £_2.i2Pg£i!:5S5i£ £i?g_£25^ ) defining 

Jke_same language. 

b > 2 I_2J^_i«S853:!? ?ii ££2g.. canonic system of Type Y t ( Y- ) , the 
language_defined_bv it is_context-sensitive (and a suitable grammar can be 
£25S£H?££S5_i5.;_!?5if I5fI?_®IIS c £ lv6 -"•oner) . 

Proof. Since Type Y 2 implies Type Y t , it is enough to prove « a)' 
for Y 2 and »b)« for Y. : 

[Type 1]« [Type Y ] C [Type Y ] CfType 1] 

a b 

["the class of languages for which there is grammar of Type 1 is included 
in the class of languges defined by c.s. of Type Y 2 , which ...", etc.] ... 

a) All we have to show is that the length-monitoring c.s. constructed 
in Donovan & Doyle 1968pp. 43-44 always satisfies Property Y, , and this 
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is ensured by the manner in which we chose our definitions. 

[Remarks. There is no need to first reduce the grammar to one of order 2; 

- the alphabet of the c.s. includes not only the terminals but also 

the nonterminals, and 2 is included among the latter; 

- there is no need for the_canonic_s£Stem itself to define the con- 

cept 'string' , since this concept is part of the definition 
of canonic systems in general; 

- for formal reasons, the canon 

[ y string ;] <E^y> production ; <y^J> greyter in length 

V"" y derived string 
is replaced by the two canons f-E initial string and 

x initial string ; <x„y> production ; <y^ a> greater in 

length L- y derived string , 
where initial string is a new, singleton predicate. ] 

b) Applying Theorem H-3 * , we reduce the given c.s. of Type Y- to 
one in which no canon has more than one premise. Since the original c.s. 
had Property X- , and since this property is invariated by the construction 
in Theorem H-3 , the resulting c.s. also has Property X- . We shall now 
construct (in a uniformly effective way) a nondeterministic multitape LBA 
which recognises the language defined by the reduced c.a. (which is the same 
as that defined by the original one). For each predicate of degree k ( k - 
1 , 2 , ...)» the LBA will have k tapes. Since each hypothesis has only 
one canon, the derivstions have a certain "Markovian" character (see Fig. 5). 
Each s tatement obtained in the derivation is used in the immediately following 
step and never needed again, and therefore can allow ourselves to overwrite 



* I am grateful to Amltava' Bagchi for the suggestion to use Theorem 
H-3 in this proof. 
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the tapes corresponding to a predicate when this predicate reappears in a de- 
rivation. The LBA will simulate nondeterainistically the derivation and will 
halt when a sentence is derived; if a string o> is a sentence then there 
is a computation path of the LBA which halts with u> displayed on the 
sentence tape, and conversely. The last step in the derivation of w is 
of the form 

< Of 4 p ^ - • • * tf ix > AB. f .M I— a) sentence ; 

by Property X- we have 

M > |o| 

M * IpI 

■ • ■ 

M > tul. '. 

Tracing back our derivation, we see that, in view of the Property % l , 
u) is at least as long as any string in the derivation, and therefore |u| 
is an upper bound, on each tape separately, on the amount of space necessary 
for recognition. 

The proof will now be concluded by rep lac ing the multitape LBA by a 
[ ,f mul tit rack 11 ] one- tape LBA and noting that each step in the chain of cons- 
tructions 



c.s. of c. s. with imiltitane context- 

Type Y x 5=^ one-premise — ¥ LBA ^ LBA ■ iss ^ sensitive 
canons grammar 



is uniformly effective. 



As an illustration to this proof, we now show how the multitape LBA 
would handle the canonic system which was chosen by Haggerty to illustrate 
his procedure. 



Wvm: V.-.^—«A-.-~'> ' ^tV^^^ 



< x y K z> ABC I — <ax c by < cz > ABC 

<y, z > 1£ I — < * „ fe y « « ^ abc 

<« <y > AB (— < ax € by , c 7 ABC 

<■ x ^ z > AC p < « € b « « > ABC 

x A f— < ax c b «. c > ABC 



y 



B |—<a < by. e c> ABC 
C | <a m b ^ «> ABC 



< x < y > BC 
x B 



| — <xb , yc> BC 

(_ <xb ^ c > BC 

y C | — <b ^yc y, BC 

|~ <t < c ;> BC 



<C x «. y> ac 



a 
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j — <xa r yc> AC 

I < x *. . c > AC 

I < a < yc > AC 



Derivation for 'aabbbcaabbb' : b B ; < a bb > AB ; < aa bbb > AB ; 
< c aabbb > CD ; aabbbcaabbb E ; 

The multitape LBA has 16 tapes (-5 • 1+4 • 2+1 • 3) . The following figure 
(Figure 6) shows the contents of these tapes at successive stages of the 
simulated derivation. 



l^#^:p^i^^fc^ 



•#?m 



r ig in a 1_ canon ic_ syg t em : 
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f— a A 






(— b B 






f— c C 




x A 


p— ax A 










x C 


I — cx £ 


x A 


; y B 


[~ nyD 


x C 


; y D 


|— y*y e 



Derivation for 'aabbbcaabbb 1 
aabbb D ; aabbbcaabbb £ ; 



b B ; a A ; bb B j aa A ; bbb B ; c C ; 



l5*?S£2I!??SL!:2 n 2 tl *' c s 2 rs tem 





j— a A 




I— b 1 




(- cC 


x A 


\ ax A 


x B 


H bx - 


x C 


H -x C 


<x^ y>AB 


|— xy D 


<x < y>CD 


|~-yxy £ 



(The decompositions are shown by 
suitable underlining) 



< x K y > AB 


L-<ax :< by> AB 


x A 


j— «ex - b > AB 


M 


|»~<« K by> AB 


t 


H <a < b > £2 


<< x y I z> ABC 


j— <cz ^ xy> CD 


•< x y>: AB 


f"T <c '' ^ xy> CD 



<*) 



(O 



C2> 
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CHAPTER V 



FURTHER HIERARCHIES OF CANONIC SYSTEMS 



The purpose of this chapter is to apply the main result of Chapter IV 
toward the development of improved hierarchies of canonic systems. 

Let us consider Doyle's hierarchy again. This hierarchy has two se- 
parate parts, one part comprising classes of canonic systems strongly 
equivalent to the class of regular graranars and the class of context- 
free granmars, and the other part comprising a class of canonic systems 
weakly equivalent to the class of unrestricted rewriting systems (Thue 
semisystems) . The hierarchy was claimed to include another class of ca- 
nonic systems, situated somewhere between context-sensitive granmars and 
recursive sets, but we have seen in Chapter IV that this class was not 
completely defined. In the same chapter, two classes of canonic systems, 

the IfSJlh^KBiSSliS^SJPSSiS^SySSSK^Sf.I^P* *i (Y.j) , were proved to 
be weakly equivalent to the class of context-sensitive languages. There- 
fore if we add any of them to the two parts of Doyle's hierarchy we obtain 

a S25Si?5S.!}iS£5r£t} v -2f-£5S25i£ w 5 v 2£52 l 5» where by "complete 91 we mean only 
that all 4 types of grammars are represented. (The hierarchy presented in 
Chapter II had correspondents not only for the 4 classic types of formal 
grammars but also for anv class definable in terms of productions.) 

While completeness is certainly a very desirable property, we cannot 
consider ourselves satisfied with it and ignore the fact that this com- 
bined hierarchy is quite heterogenous: for Types 3 and 2 it provides 
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simple canonic systems with predicates of degree 1 ; for Type 

simple canonic systems with predicates of degree 2 ; and for Type 1 

the canonic systems are not even simple. The form of the hierarchy may 

be schematically summarized as 



SI SI G2 S2 
(for Types: 3 2 1 ) 



Our first step toward "homogenization" will be to reduce the third 
class from G2 to S2 . Clearly, we can always reduce a general c.s. 
to a simple one by using Theorem H-2 , but we need a class of simple 
c.s., weakly equivalent to context-sensitive grammars, and the property 
'obtainable from class «4 by eliminating contextual references' is not 
a good criterion for class membership, since a criterion should refer to 
the form of the new system, irrespective of how the c.s. was obtained. 
We have seen that the length-monitoring c.s. cannot be simple, by defi- 
nition, since they all include the offending canon 

<x < y> length ; <z < yl> length L~ <z € x> greater in length 
If we modify IV. (2).., (8) by replacing this canon by the canons 






length ; <z yu> length ; u unit U— <z x> greater in length 

Ci>| . ' 

unit [singleton predicate] 



and call the canonic systems which include (1) and IV. (2) . . .(5) ,(7) . . . 
(8) s- length-monitoring canonic systems, we can build for them a theory 
similar to that of Chapter IV. 

Definition 12. A simple s-monitoring canonic system is of Type__Y- 
(respectively Y £ ) if it has Property Y 1 ( Y 2 ) . Property Y 1 ( Y 2 ) 
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for s- length-monitoring canonic systems U defined in a similar manner aa 

for length-monitoring canonic systems, but the condition '2)* in that de- 
finition will now exempt from the decompoaability requirement the modified 
canons used here for monitoring length. 

Thegrgm^7 . 

a) Giyen_an^contmt-senait^^ 

uniformly ^efffct Jyel^find^a^graijBiar^for^i^j; 

Proof, a) The only contextual referencing in the canonic Bystems of 
Theorem 6a was in Canon IV. (6) . If we replace that canon by (1) we 
get a canonic system which is simple, s- length-monitoring, of Type Y 2 
(and therefore also ? l ) , and defines the same language. 
/ b) Completely similar to the proof of Theorem 6b . [Theorem 7b is 

not a particafar case of Theorem 6b since a- length-monitoring c.s. are, 
formally, not the same aa length-monitoring c.s.] 

We have thus obtained a hierarchy of the form 

SI SI S2 S2 

i.e. a hierarchy of simple canonic systems (of which the last class 
contains all the simple c.s. with oredicatea of degree 2), and we shall 
try to reduce it to the form 

SI SI SI SI 
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The last class can easily be so reduced* For any r.e, set there is 

a simple c.s. with predicates of degree 2 which defines the given set, 
and this c.s. may be reduced to one with predicates of degree 1 (by The- 
orem H-l) while remaining simple; and the converse result is certainly 
true, since sets defined by canonic systems are always recursively enu- 
merable. 

The hierarchy has now the form 

SI SI S2 SI 



Unfortunately, Theorem H-l appears to be of no further use in reducing the 

form of the hierarchy, since none of the 4 classes mentioned in this 

chapter as being weakly equivalent to context-sensitive grammars 

(length-monitoring canonic systems of Type Y- ; of Type Y« ; 

simple s- length-monitoring c«s. of Type Y- ; of Type Y* ) 

is invariant under the transformation involved in the proof of Theorem 

H-l. 

Having thus arrived at an apparent "dead end!' in our endeavors to 
develop and simplify Doyle's hierarchy, we now consider the pther basic 
hierarchy, the hierarchy of general c.s r with predicates pf degree 1 
(of the form Gl Gl CI Gl ) 

which was Introduced in Chapter II, and apply to it Theorem H-2. 
It is easily seen that we obtain indeed 4 types of fia|^nic systems, 
i.e. valid criteria can be stated (depending only on the form of the 
transformed canonic system) for membership of a c.s. in a type. These 
types of c.s. may also be introduced independently, fhe following de- 
finitions are analogous to Definitions 2... 5 . 
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Definitional^ A single canonic system is of Type 0^ if each 

of its canons, except for 4 of them, is of one of the forms 

(2) xuy derivable ; u U ; v V J— xvy derivable 

(3) |— H M (x, y, u, v are variables) 

(4) |_» a terminal 

where 

(a) \x (a meta-variable) stands for a particular string; 

(b) for any predicate appearing in a canon of form (2) , except 
for the canon derivable , there is exactly one canon of form (3) , 
i.e. U , V , M are singleton predicates; 

(c) if U i V (in this order) are two singleton predicates appear- 
ing in a canon of form (2) , and if [x , 9 are the corresponding strings, 
then [x and V can jointly be put in the form 

i± - <p A y 

where <f , t|* , w are [meta-variables standing for] particular strings, 
possibly empty, and A does not appear in a canon of form (4) , 

the 4 other canons being: 

(5) f-2 derivable 

(6) f— X terainal_string 

(7) x terminal ; y terminal string |— xy terminal atring 

( 8 ) x derivable ; x terminal string L- x sentence 



^r;A;&^:k^S^^ 
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(a) 

Definitioij_14. A simple canonic system is of_Tj£ge__l__^ if ifc is 

of Type (r 8 ^ and satisfies the additional condition that for each canon 
of form (2) the corresponding string 0) (defined in (c) ) is non-null. 



(s) 
Definitional^ A simple canonic system is gfjjjjft^^ if it is 

of Type 1^ and satisfies the additional condition that for each canon 

of form (2) the corresponding strings &, Mf (defined in (c) ) are 

null. 

Definitional^. A simple canonic system is ofJC^e__32*_ if it is 
of Type 2^ s ' and satisfies the additional condition that for each canon 
of form (2) the corresponding string a contains just two symbols, 
one terminal and one nonterminal (one for which there is a canon of form 
(4) and one for which there is no such canon), always in the same order. 

The definitions of linear, ope-sided^linear, metalteear, seguential, 
left-^context-sensitiye^ etc., grammars may be similarly imitated, and 
so we may speak (Definitional?) of linear, one-sided^ linear, metalinear, 
seguential, left; x context-sensitive x , etc., siKle^canpnic^syst^as. 

Theorem^ [Analogous to Theorem 1] . For^any^simgle^canonic^system 

of T^^i^^^i^jj^i^^s^^ 

gene rates the^saM^language^^and^conversely^ 
Proof. Similar to that of Theorem 1. 

The second part of Theorem 8 (the converse result) can be proved 



^;r-^,;^-^,^^;^^^ 
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more easily if we use Theorem 1 and the following obvious Lemma: 

Lennta. The result of applying the procedure of Theorem H-2 upon 
a canonic system of Type i ( i « 0, 1, 2, 3) is a simple canonic sys- 
tem of Type i (s) . 



Theorem 8 provides us with a hierarchy of simple canonic systems 
with predicates of degree 1, that is a hierarchy of the form 

SI SI SI SI 

and the goal of the present chapter is thereby completely achieved. 
Before concluding this chpter, however, we should like to point out an 
interesting fact which provides a link between the two basic hierarchies 
developed in this chapter (the one of the form SI SI G2 S2 
~ based on Doyle's — and the other of the form Gl Gl Gl Gl , 
introduced in Chapter II) . When we wanted to reduce the first basic 
hierarchy to one composed exclusively of simple canonic systems and no- 
ticed that its third class, the length-monitoring c.e. of Type Y. , failed 
to be simple only because one of the canons used in monitoring string 
lengths included contextual referencing, we just replaced the offending 
canon. But there is absolutely no need for a canonic system to monitor 
itself the lengths of the strings. A context-sensitive granmar does not 
monitor the lengths of its strings, and it is no less noncontracting be- 
cause of this; strings grow in length not because the granmar monitors 
their lengths (which it does not) but just because the productions are 
noncontracting. When we examine the grammar "from the out aide" (by 
using a meta-system) we can prove that the strings are bound to grow; 
but there is no need to duplicate this proof inside the object system (the 



^.^j.s^e^sy 
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granmar - or the canonic system). We therefore eliminate the canons 

IV.(2) . . .(8) , and the canonic system becomes now simple. It still con- 
tains canons of the form ■ . • 



LlM» 



4> foAU* to w V^ production 

(one for each production epAur^y^y ; Donovan & Doyle 1968, p. 43), 
and we just know that in each such canon ("f^ 1 •"" This, however, does 
not yet solve our problem. We have to rtdefjtfte the concept *e.s. of Type 
Y- f , or, more exactly, to redefine the relation ^ ; and this relation 
has to hold, sometimes, between two different variables, *4 for example, 
in 

(9) wxz derived string ;<x^^ production ;<y c x >gre*ter it> length |-wyg de- 

rived string 

where we ought to be able to prove that x^y • #or length^monitoring 
c . s . we could say that x 4 y because the premise € y ^xfr greater in length 
is present (Definition 10. lc), but we do not have the predicate J£gs£££ 
in length any more, and we are still under the obligation to ascertain, 
by merely inspecting the canons, whether or not the canonic system if a 
member of the class we define* One way to solve the problem of eliminat- 
ing length-monitoring and still being able to define ^ Is to abplisVthe 
need to ever compare (in length) two distinct variables* Then «4 would be- 
come an absolute relation, not dependent ok the canonic system, and defined 
by .la.lb*2a.2b.3. of Definition 10 (i.e. without .le*>. To achieve 
this end we have to replace canon (9) by a a many canons as there are pro- 
ductions, each new canon being the result of "plugging in M a particular 
production in the canon (9) : 

(10) v^Ayz derived string j— vttup derived string 
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The class of canonic systems of Type Y (from the first basic hierar- 
chy) is thereby transformed into a class which is, essentially, no 
different from the class of canonic systems of Type 1 (from the second 
basic hierarchy; Definition 3), and from here the whole second basic 
hierarchy is just one small step away. 
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CHAJtER VI 



NON-CiOSSKEFERENCING, SIMPLE, AKO «0M MSBMING SAHQ10& SYSTgHS 
CLASSIFICATION OF CAWQKIC SYSTIKS 

i 

In this chapter we pursue an idea mentioned in Chapter I — that 
one should not distinguish (and name) the subclass of canonic systems 
with contextual referencing, with insertions, with crossreferencing, 
but one should rather consider the subclasses of canonic systems without 
the respective options. Canonic systems without contextual referencing 
(simple c.s.) were extensively studied in Chapters I and V; we shall now 
formally introduce the other two classes and investigate their computa- 
tional power, 

Crossreferencing was defined [Donovan & Doyle 1968, p. 27] as con- 
sisting of the use of one and the same variable more than once in the 
term of the conclusion or the use of one and the same variable in more 
than one premiae in the hypothesis. The possibility of a variable being 
used in exactly one premise of the hypothesis but occurring several times 
in that premise is not included in this definition. On the other hand, 
there is a fundamental difference between multiple occurrences in the 
hypothesis part of the canon and multiple occurrences in the conclusion. 
The applicability of a canon in a particular situation has to be esta- 
blished before the canon could be used, and the applicability depends 
only on the hypothesis of the canon; if the hypothesis contains two 
occurrences of a variable, we have to check that the strings matched by 
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the two occurrences are identical strings (substrings), and this checking 
is not an elementary action. Multiple occurrences in the conclusion, 
however, have no influence on the applicability of the canon. This argu- 
ment suggests that we should specifically exclude from the definition of 
crossreferencing multiple occurrences in the conclusion, and include 
multiple occurrences of a variable within one premise of the hypothesis. 
The same point of view is taken by Turing (in connection with Turing 
machines) and by Minsky (in connection with Post's canonical systems) . 
Quoting from Turing 1936 [p. 137 in Davis's collection]: 

"If, on the other hand, [the squares] are marked by a se- 
quence of symbols, we cannot regard the process of recognition 
as a simple process. This is a fundamental point and should 
be illustrated. In most mathematical papers the equations and 
theorems are numbered, ... But if the paper was very long, we 
might reach Theorem 157767733443477; thin, further on in the 
psper, we might find ' ... hence (applying Theorem 1577677334- 
3477) we have ...' . In order to make fu** which was the re- 
levant theorem we should have to compere the two numbers figure 
by figure, possibly ticking the figures off In pencil t$ *ake 
sure of their not being counted twice." . 

Minsky [1967, p. 231] remarks that he could have allowed multiple occur- 
rences of variables within any premise, but chose not to: 

''Post's most general formulation allowed eaeh production to 
have severs 1 antecedents. ... Also in Post's most general for- 
mulation, he alloweS'two of the $'a in the ftttecede nt to be the 
same. This meant that the rule of inference"woul3"apply only 
to a string (theorem) in which there v*t an exact repetition 
of some (variable) substring in two places in the antecedent. 
We prefer to prohibit antecedents of this form, not because we 
went to restrict the generality of the systems, but because it 
would run counter to our intuitive picture of what ought to be 
permitted as elementary, unitary operations." # 

With this motivation (and backing) we change the definition of ' cross re f e- 
rencing' to read: 
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?S£iEiBi2?-i? - A c a«on is said to S2£tain_crossre£erencing if at least 
one of the variables involved in it occurs more than once in the hypothesis 
of the canon, whether these occurrences are within one premise or are in 
different premises. 

Definitional^ A canonic system is non- cross referencing if none of 
its canons contains cross referencing. 

Let us consider now the phenomenon of insertion, whose definition is 

_«* m m m m m m mt m 

implicit in the traditional definition of canonic systems with insertion 
as canonic systems in which terminal symbols are inserted between the 
variables of one string to form a new string* Since we are interested in 
canonic systems without insertions, we tentatively define canons without 
insertion as canons in whose conclusion no symbols appear, i.e, whose 
conclusions contain £gggy^gg^^ rather than ^^^m^Sm^a^ 

of variables and words . The formal modifications required in the defining 
second- level canonic system are not difficult to figure out, but the defi- 
nition would be forbiddingly restrictive: the axioms would be totally 
useless. In fact, we never defined axioms formally, but just referred by 
this name to any canon whose list of premises was empty, and therefore any 

il ■ ■.■lll^l.l I II -H W . — III H II» ■ w 

restriction on the canons is automatically a restriction on the axioms. 
This suggests the following definition: 

Definition 20. A canonic system is non-inserting it it has the pro- 
perty that in all its canons , except for the axioms, the term in the 
conclusion of the canon has only "pure" elements, i„e. each element is 
either a concatenation of variables or a concatenation of symbols. 

The following canonic systems will be used as examples: 



^ss^^m^^ms^ 



■■?-■; --/,^.^^.-^^.-:>-. irteigy&A: v^^*^^^i^ 



W^a 



1. 
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Language: set of balanced (well- formed) strings of 
parentheses ■-.-.,., 



v-{( ,,} 



{Minsky p. 230] 



I () theorem 

x theorem | — (x) theorem 

x theorem |— xx theorem 

x()y theorem / — xy theorem 



one- predicate (Post) 
non- cross referenc in g 



1'. Same language, same alphabet. [Minsky p. 230] 
I— () thegrem 
x y theorem J- — x()y theorem 



simple 

one "predicate 

non-crossreferencing 



2. Language: palindromes over a , b , c # {Minsky P- 228] 





f- f A 




\— b L 




f— c A 




1 — aa A 




h bb A 




| — cc A 


x A 


| — «a A 


x A 


{ — bxb A 


x A 


I — cxc A 



simple 

one -predicate 
non-crossreferencing 



Same language. [Minsky p. 228] 







f — a A 






f b A 






/ — c A 


X 


A 


\ — axa A 


X 


A 


f— bxb A 


X 


A 


f~— cxc A 


X 


A 


\ — xx A 



simple 

one- predicate 

non* cross referenc ing 



rr^^^T^^^r^jrr^^,^^-: .^^^^^^- 
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3. Language: all true statements about adding 1-ary poeitive Integers 

[Minsky p. 229] ( 3 - '111* f etc.) 

v - ii , + , -} 

f— 1+1-1 add 
yfyz add f-xl+y«*l add 
x+y-z add f— x+yl-al add 
[or: x+y«s add f— y+x*z add ] 



one-predicate 
non-cross referencing 

inserting 
not simple 



4. Language: all true statements about multiplying 1-ary positive 
integers [Minsky p. 229] 

V- {l , • , - } 



{—1*1-1 mult 
x»y-s milt |— xl«y«zy mult 
x.y-s mult |— yx-s mult 



one- predicate 
non-crossreferencing 

inserting 
not simple 



5. Language: jiViV J m , n natural numbers J 



h- a A 

hb A 
x A f~ ax A 

x B (-fax B 

x A ; y Bf-xyxy aentence 



simple 
non-erossreferencing 

inserting 



5' . Same language. 
I- -A 

h b B 
x A ; y A J-* xy A 
x B ; y B (-xy B 
x A ; y I p xyxy aentence 



simple 

non- inserting 

non-croas referencing 



h^^-ysz-f-^^m^m^^i^l 



fc^^^-^^.iV^^:^*.^^*^*!^^ 



^fss^^^i^^SI^ 



6. Language; squares In l-ary 
Alphabet - { 1 , * j 

|— 1* A 
x*y A |— xll*yx A 
x*y A j— y Square 
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non-crossreferencing 

not simple 
inserting 



6 1 . Same language. 
[Mentioned here for completeness; will be introduced later.] 



5". Language: same as 5 • 

hb B 
x A ; y Aj-xy A 
x B ; y B J-xy B 

x A ; y B ; z B {— xyxz ABA 
x A ; y A ; z B |— xzyz BAB 



x ABA ; 



BAB ( — 



simple 

non- inserting 



cross referencing 



x sentence 



x ABA 



5 MI . Same language 

f- a A 

x A j — ax A 

j_ b B 

x B \ — bx B 

ABA 
BAB 

; x BAB f— x sentence 



as above 



simple 



inserting 
crossreferencing 



5 mt . Language: a b a d m , n natural numbers 
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The first 6 canons of 5". 
Last canon replaced by 

ax ABA ; x BAB x sentence 



non- inserting 

not simple 
cross referencing 



5 • Same language. 



The first 4 canons of 5* 
Last canon replaced by 



non- inserting 

non- cross referencing 



x A ; y B xyxy ABAB 
ax ABAB x sentence 



not simple 



^^^■WWW^^^^^s^'il^^W 
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Of the classes of canonic systems considered until now, only the 
two classes which correspond, in the first basic hierarchy, to regular 
grammars and to context-free grammars are non-crossreferencing. Since 
they are also simple and non- inserting, this implies that non- inserting 
c.s., non- cross referencing c.s., and simple non- cross referencing non- insert- 
ing c.s. are all powerful enough to define any context* free language* 
The following figure shows the new classes 6£ canonic systems (the numbers 
refer to our examples): 




Figure 7. _ 

Classification of canonic sys 



: %j^&sfeggffs*^^ m^M^^m^ ^^^m^^^^ ^ XU ■,]^^^^^^i^ ^^^04^m^^^^^^^^^^. 
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Introducing the abbreviations ' * 

Q » non-crosareferencing '*•*• 

R * non-inaerting ca, 

S * a lop la c#a. 

Ql - QA* 

Q«? - Q\R etc. 

QBff - (Q A R)\S 



we have 



{ 



[QBS] SP [CF] (since (5*) defines a non- , context- 

fren, language ) 
[QB] ^ tCF] 

[Qs] —j [CF] A» before, {cless of c.s.] ■? class of 

*^ languages definable by the clsss c o| 

[SB] S C -finite intersections of CF languages] 

(since they i.ean, be obtained by cross- 
referencing; m note that the lan- 
guage of (V) 1* included in this 
class) 



[Ql ^ ICF] 
[B] ^ J fin 
[8] — « Ir.e.J 



[B] a 1 finite intersection* of CF] [Result inproyed 

below] 



Since a c.s. in QBS cen be trivislly nodlfiad so am to belong to 
JjBS or QBS or QB? , ne also have 

[QBS]5* [CF] 
[Q*l ^ [CF] 



Similarly, 



finite 
[Q"**1 9 [intersections of CI] 



iS^g^gCTWW^^ 
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[QRS] ^ [CF] 



We shall now show that the non- inserting c*s< are powerful enough 
to define any r.e. set; {Rj - [r.e*l .,_.-.. A* for the m>n-erosare£eren- 
cing c.s., we have not been able to improve the result stated above 
( [Q]^[CF] )• It is known that non-cltoasreferencltti c.s. with one 
predicate of order 1 cannot define the set of squares in l^ary (see 
[Minsky 1967, p. 235]). 

Hjgglffl^ {analogous to theorem ft*2 {of H«gge*ty)] . $*l m $±$>_$™ 
-f-rS^SSS^.SS^f.BSBziSSSrSiBS.SfSfiBi* 5 »y«tea. 

?I22ii An y ^^ (««qu«nce of symbols) in the conclusion is replaced 
by a variable Whose value is specified (by an additional premise) to be 
in an (adequately defined) singleton predicate. This implies that the 
desired reduction is possible. 

Remark. This procedure invariates the class of non-crofis referencing 
canonic systems; it is recalled that the elimination of words from the 
-JfPSStSS^S of a c anon introduced crossreferencing. 

We shall now develop a complete hierarchy of noti- inserting c.s.. 
Since the first two classes Trom the first ba a ic hierarchy (of the form 
SI SI G2 S2 ) are already non- insert lag, we shall retain them and 
adapt the last two to our purposes. 

The most general non- inserting c.s. obviously generates an r.e. set; 
and we have seen that for any r.e. set there is a non- inserting c.s. de- 
fining it (by Theorem 9). This gives us a class corresponding to Type 0. 



• ^ E B ^iKg F ^f-:.^ - .■ " ---t~::z^^^-;^"- ^4^^^^^- - r .-? y^^55£7^^^^^ 
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As for Type 1 , we have a result completely stellar to Theorem 7 (Ch. V) . 
Before stating it, we need a few definitions. We would like to talk 
about non- inserting length-monitoring c.s.; but all length-monitoring 
c.s. < as previously defined) include the (inserting] canon 

IV. (5) <x^ y> length ; z symbol f«-<xz^yl> length 

[A similar situation was encountered just before Definition 12.] By re- 
placing this canon by 

< x m y> length ; z eygbol ; u unit |— <xz :< yu> lepgth 
| — 1 unit [singleton predicate] 

In the definition of 'length-monitoring 1 we arrive at the definition 

of £;iS5gth^monitoring^c z s ; (similar to s- length-monitoring c,s.). 

Similarly, if we perform this replacement in the definition of 

•s- length-monitoring 1 , we arrive at the definition of j;;l;5gJJ};525iS2liSS 

canonic^s^ ti|g • 



£1 

a) Given any context-aensltive grammar, one ^^JJjf^fjJy.ffff^ffyf^y 

construct^ jaon-inserti^^ 
definini^the^same^lang^ie^ 

b) For any non^- inserting r-l^gtk** ^ ^ ?^^ 

the language defined by it is context-sensitive (and one can uniformly 



* Definition similar to Def . 12. 



■J^^P^P^^pf^^ 
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Proofs Analogous to that of Theorem 7. 

We have thus obtained a hierarchy of non-inserting canonic systems. 
The form of this hierarchy may be described as 

Rl Rl R2 R2 

Rl . . 
(More exactly, RSI Kl RG2 RSI .) 

We shall npw define ]?ure_ canonic systems. 

25fiS£**25L?lj:" A ca «onic system is said to be pure if it is simple 
and non- insert tag. {"pure" since all concatenations contain either 
exclusively symbols or exclusively variables.] 

A complete hie J5£5hy_of_£ure_<c.s. , of the form 

RSI RSI RS2 RS2 
RSI 

can be easily obtained, in a manner entirely similar to that in which 
the hierarchy of non- inserting c.s. was obtained. However, we prefer to 
present another hierarchy, based on the second basic hierarchy (form: 
Gl Gl Gl Gl ). At the end of Chapter IV, we found a hierarchy of 
simple c.s. with predicates of degree 1 : si SI SI SI . 
(Cf. Def. 13, 14, 15, 16 and Theorem 8.) By inspecting the definitions 
of the classes of simple c.s. involved, it is easily seen that these 
canonic systems are also non- inserting. Therefore we have obtained: 



^;*^^*^^^^?»^ 
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SI SI SI SI 

Sl-^^SJSS.^ifl.fSi^fliyi^S.tiSfJISij^S^g^S c * non *c systems, 

... — ' K ■ . ■- '...'■.■■■.. ■. 

RSI RSI RSI RSI '.. . 4 

The next logical step would be to look for a hierarchy of the form 

QRS1 QRS1 QRS1 QRS1 . We suspect that such a result ia impossible to 

obtain, and, more precisely, that the non^eroswrefereiicing c.s. are not 

sufficiently powerful to define any language of Type or 1 . We shall 

now introduce a modification in their d^finit|^n, jpp4iJi«ation which will 

enable us to obtain a complete hierarchy. Fojg^winft Minsky 1 * [1967, p. 

235i definition for Post systems, we shall call ■SSB&l£J$itt£3£d£&& m T2Eh 

li!S*3L*iPl}f bet a fpittsl jByjtem, similar to ordinary 
Definitions. **■-**- : -r ' 

c.s. but in which a subset T of the alphabet V is 
singled out (and called tttM^ral^a^^v^ili^^CM-^lMiBfi'^the language it 
defines is 

U$ , A ) . The set V>T is called auxi liary alphabet 



The difference between canoric systems with auxiliary alphabet and 
ordinary canonic systems becomes significant only iq the case of 
non- cross referencing canonic systems* For all other canonic systems we 
could define a predicate terminal string and then achieve the desired 
effect by adding a canon like 



«gv ■- ., ■r.i^-.^r-^. C-*;*-^?->.^:=' . '«A.i;- ::?/n&»^ £^*?^ ^^^S^ 



^gfe^^#K^^^ 



77 



x sentential form : x terminal string t— x sentence 



Example. The set of squares In 1-ary. 



6'. 



V = {l , *} 
T- {1} 



Canons : 



J- 1* A 

x*yA|- xll*yx A 
x*y A L~ y A 



non-crossreferencing 

one-predicate 

Wttk AtflttL. ALPHABET 

oot ftli^le 
inserting 



Examples 6 and 6 V show that a set may be undefinable by Post 
systems (canonic systems with one predicate of degree 1 and no auxili- 
ary alphabet) but become definable if we either allow one more predi- 
cate or allow an auxiliary symbol. This "trade-off" between additional 
predicates and additional (auxiliary) symbols is, in fact, an instance 
of a general result: 



Post systems 



more than one predicate 
[(w.l.o.g.) of degree 1] 

CANOITXC SYST&CS 



(A) 



it 



(B) 



\ 



one predicate of degree 1 ; 
auxiliary symbols 



(C) 




one predicate of 
higher degree. 



(A): Trivial. 

(B)(C) : [Haggerty 1969, p. 44] * 



* Theorem 3. However, the statement of this theorem, "Any canonic 
system can be simulated by a Post "system! 11 , must be supplemented by the 



t fj%feg#ag# gii!^^ ■ ^^m^^f^^m^- 
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(B) may also be proved by using Theorem E-3 and the proof of Theorem 6b. 
[The number of the predicates will be the number of tapes of the LEA.] 

(C); Proved by introducing separators acting as auxiliary symbols. 
A result similar to (B)(C) has been announce fey '«. Xohn (.19691$ it in- 
volves variables whlcfc range on all but one of the symbols in the alphabet, 

Having defined and exemplified canonic systems with auxiliary alpha- 
bet, we are now ready to derive a hierarchy of non-crossreferencing ca- 
nonic systems with auxiliary alphabet. 



a) Non-crossreferencing canonic systems with auxiliary alphabet 

b) A complete hierarchy of such canonic systems may be obtained from 

»^ •»—••»•*» m m mm mm mm'mm mmmmmm mmm m mm mm m-mmmmmlfi mmmmmmmmmmm mm mm w «»«• »*»■§«■■»•»«» ~ 

Sije^second^basic^hierarchy^ 

Proof. Obviously, it is sufficient to prove 'b)' . 

The only canon with cross referencing in the canonic systems from the 
above-mentioned hierarchy (Chapter II) is 

x derivable ; x terminal string L» x sentence 

"' ■'■'■■■ -.-■... j 

By eliminating it from a given c.s. (together with the canons which define 

the predicate terminal string ) and by replacing the axioms of the form 



h 



a terminal 



qualification "...which is a canonical extension [in Minsky's sense] of 
the given canonic system." , since there are formulas which are theorems 
in the Post system without being theorems in the given canonic system, 
and all such formulas contain auxiliary symbols not in the alphabet of 
the given canonic system. The canonic systems 6 and 6 f above are 
examples of systems which can not be simulated untesa we allow canonical 
extensions. 



i-^. . /-^r-^^'-V's?^^ -!-:;■„-;.; 



^-^^?#3§^ 
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by « declaration 

T -{•»... } , 

we obtain a canonic system equivalent' to the given one. The theorem 
now follows. 

OPEN PROBLEMS: 

1. "[QRS] m ? » Find the ccw^iutational power of the class of 
simple, non-^ross referencing, non-inserting canonic systems (no auxi- 
liary alphabet, any ouabr of predicates). [ [QKSJ^tCF] J 

2. " [Q] * ? " Find the computet ioiiel power of the class of 
non-crossreferencing canonic systems (no auxiliary alphabet, any number 
of predicates). [Includes all finite intersections of context-free 
sets.] 

3. " [Qj] - ? » Find the computational power of [unext ended] 

Post systems (non-crossreferenctog, no auxiliary alphabet, one predicate 
(necessarily of degree 1 ) ) . 
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